United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
I nilid Stall-, l'atint and Trademark Office 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



10/808,615 03/25/2004 

7590 03/31/2008 

MCDERMOTT, WILL & EMERY 
600 13th Street, N.W. 
Washington, DC 20005-3096 



Masayuki Masuyama 



WANG, KENT F 



PAPER NUMBER 



DELIVERY MODE 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



l/ffflrC? nVrliUli Otfff Iff ids y 


Application No. 

10/808,615 


Applicant(s) 

MASUYAMA ET AL. 


Examiner 

KENT WANG 


Art Unit 

2622 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )KI Responsive to communication(s) filed on 15 February 2008 . 
2a )□ This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-19 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1 and 19 is/are rejected. 

7) [3 Claim(s) 2-18 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.Q Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1) ^| Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) Information Disclosure Statement(s) (PTO/SB/08) 5 ) □ Notice of Informal Patent Application 
Paper No(s)/Mail Date . 6) □ Other: . 



PTOL-T26 d (Rev e 08-06r 



Office Action Summary 



Part of Paper No./Mail Date 20080320 



Application/Control Number: 10/808,615 
Art Unit: 2622 



Page 2 



DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 
CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 

1 .17(e) has been timely paid, the finality of the previous Office action has been withdrawn 
pursuant to 37 CFR 1.1 14. Applicant's submission filed on 02/15/2008 has been entered. 

Response to Amendment 

2. The amendments, filed on 02/15/2008, have been entered and made of record. Claims 1-19 
are pending. 

Response to Arguments 

3. Applicant's arguments with respect to claims 1 and 19 have been considered but are moot in 
view of the new ground(s) or rejection. 

Claim Rejections - 35 USC § 103 

4. The text of those sections of Title 35, U.S. Code not included in this action can be found in a 
prior Office action. 
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5. Claims 1 and 19 are rejected under 35 U.S.C. § 103(a) as being unpatentable over Sakuragi 
(US 2001/0033337) in view of Kudo (US 6,784,931) and further in view of Sanchez (US 
7,009644). 

Regarding claim 1, Sakuragi discloses an imaging device (solid state imaging pickup 
device) that outputs brightness information (image signal) according to an amount of incident 
light, comprising: 

an imaging unit (an amplification-type MOS sensor) that includes a plurality of 
unit cells (sensor cell) arranged two-dimensionally, each unit cell (sensor cell) 
including a photoelectric conversion part (photodiode 1 , Fig 3) that generates a 
first output voltage (output voltage in vertical signal line 15, Fig 3) in a reset state 
(voltage is applied to the reset signal line and the photodiode is in a reset state) 
and a second output voltage (voltage in horizontal signal line 17, Fig 3) according 
to an amount of incident light (light incident onto the sensor), and each unit cell 
(sensor cell) generating a reset voltage (voltage at level H pulse 103, Fig 4) that 
corresponds to the first output voltage (output voltage in vertical signal line 15) 
and a read voltage (voltage at level H pulse 102, Fig 4) that corresponds to the 
second output voltage (voltage in horizontal signal line 17) ([0060]-[0061], 
[0065], and 0070]-[0071], Sakuragi); and 

an output unit (output amplifier 20, Fig 3) operable to output, in relation to each 
unit cell (sensor cell), output brightness information (image signal) indicating a 
difference between the reset voltage (voltage pulse 103, Fig 4) and the read 
voltage (voltage at level H pulse 102, Fig 4) when normal light is incident to the 
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imaging device (light incident onto the sensor) and the read voltage (voltage pulse 
102, Fig 4) is in a predetermined range (reference voltage V R ) ([0065]-[0071], 
Sakuragi). 

Kudo discloses the output brightness information indicating a difference between the 
reset voltage (a reset pulse signal ())RST, Fig 4) and the read voltage (a read pulse signal 
())SEL, Fig 4) when normal light (a low brightness object) is incident to the imaging device 
(amount of light incident onto solid state imaging device 100, Fig 1) and the read voltage (a 
read pulse signal ())SEL ) is in a predetermined range (reference potential of the photodiode 
101 Fig 2), and brightness information indicating high brightness when strong light (a high 
brightness object) is incident to the imaging device (solid state imaging device 100) and the 
read voltage (a read pulse signal ())SEL) is not in the predetermined range (col. 6, line 66 to 
col. 7, line 61, Kudo). 

Sakuragi and Kudo do not explicitly disclose an output unit operable to replace the first 
brightness information with second brightness information indicating higher brightness than 
the first brightness information. 

Sanchez discloses an output unit operable to replace the first brightness information with 
second brightness information indicating higher brightness than the first brightness 
information and then output the second brightness information when strong light is incident 
to the imaging device and the read voltage is not in the predetermined range (as shown in Fig 
2, the defective pixels that have passed through the statistical database filter are corrected in 
step 224 and the erroneous raw brightness data for a defective pixel is replaced by that pixel's 
local average brightness value, which is the average brightness value of all its immediately 
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neighboring pixels and then the corrected data from the defective pixels as well as data from 
non-defective pixels is prepared to be sent for subsequent processing in step 226, and for 
each pixel whose data that has been acquired, its local brightness deviation is compared to 
the deviation threshold as in step 218 and any pixel whose local brightness deviation exceeds 
the threshold deviation value is then flagged as a defective pixel and the statistical database is 
then queried, to determine whether the defective pixel's data value should be corrected in step 
222) (col. 5, line 30 to col. 6, line 7, Sanchez). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
voltage output operation as taught by Kudo into Sakuragi's image pickup apparatus, as to 
make possible the advantages of providing an amplification type solid state imaging device 
capable of generating a relative light-strength detecting scheme and make it possible to take a 
preventive measure against shadow detail loss due to a voltage reset operation (col. 2, lines 
30-34, Kudo). 

And it would also have been obvious to one of ordinary skill in the art to have further 
included the image sensor as taught by Sanchez into Kudo and Sakuragi's image pickup 
apparatus, as to make possible the advantages of providing a method and a system for 
dynamically correcting anomalous pixels in the raw data taken from an image sensor array 
such as a CCD or a CMOS sensor array, thus allowing the use of dumb cameras to capture 
digital images for subsequent use by an intelligent host—such as being displayed on a 
computer monitor (col. 2, lines 30-36, Sanchez). 

Regarding claim 19, Sakuragi discloses an imaging method for use in an imaging device 
(solid state imaging pickup device) that includes an imaging area formed by a plurality of 
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unit cells (sensor cell) arranged two-dimensionally and outputs brightness information 
(image signal) according to an amount of incident light (light incident onto the sensor), each 
unit cell (sensor cell) including a photoelectric conversion part (photodiode 1, Fig 3) that 
generates a first output voltage (output voltage in vertical signal line 15, Fig 3) in a reset state 
(voltage is applied to the reset signal line and the photodiode is in a reset state) and a second 
output voltage (voltage in horizontal signal line 17, Fig 3) according to an amount of incident 
light (light incident onto the sensor), and each unit cell (sensor cell) generating a reset 
voltage (voltage at level H pulse 103, Fig 4) corresponding to the first output voltage (output 
voltage in vertical signal line 15) and a read voltage (voltage at level H pulse 102, Fig 4) 
corresponding to the second output voltage (voltage in horizontal signal line 17), the method 
comprising a judgment step (voltage is applied to clamp capacitor 13, Fig 3 and set the W/L 
ratio) of judging, in relation to each unit cell (sensor cell), whether the read voltage is in a 
predetermined range (reference voltage V R ) ([0066]-[0067]; 
Kudo discloses the method further comprising: 

- a first output step of outputting brightness information (image signal, the 
potential in the column line 4, Figs 1-4) indicating a difference between the 
reset voltage (a reset pulse signal (|)RST, Fig 4) and the read voltage (a read 
pulse signal ())SEL, Fig 4) when normal light (a low brightness object) is 
incident to the imaging device (amount of light incident onto solid state 
imaging device 100, Fig 1) and the read voltage (a read pulse signal ())SEL) is 
judged to be in the predetermined range (reference potential of the photodiode 
101 Fig 2) (col. 6, line 66 to col. 7, line 61, Kudo); and 
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a second output step of outputting brightness information (image signal, the 
potential in the column line 4, Figs 1-4) indicating high brightness when 
strong light (a high brightness object) is incident to the imaging device (solid 
state imaging device 100) and the read voltage (a read pulse signal ())SEL) is 
judged not to be in the predetermined range (col. 6, line 66 to col. 7, line 61, 
Kudo). 

Sakuragi and Kudo do not explicitly disclose an output unit operable to replace the first 
brightness information with second brightness information indicating higher brightness than 
the first brightness information. 

Sanchez discloses an output unit operable to replace the first brightness information with 
second brightness information indicating higher brightness than the first brightness 
information and then output the second brightness information when strong light is incident 
to the imaging device and the read voltage is not in the predetermined range (as shown in Fig 
2, the defective pixels that have passed through the statistical database filter are corrected in 
step 224 and the erroneous raw brightness data for a defective pixel is replaced by that pixel's 
local average brightness value, which is the average brightness value of all its immediately 
neighboring pixels and then the corrected data from the defective pixels as well as data from 
non-defective pixels is prepared to be sent for subsequent processing in step 226, and for 
each pixel whose data that has been acquired, its local brightness deviation is compared to 
the deviation threshold as in step 218 and any pixel whose local brightness deviation exceeds 
the threshold deviation value is then flagged as a defective pixel and the statistical database is 
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then queried, to determine whether the defective pixel's data value should be corrected in step 
222) (col. 5, line 30 to col. 6, line 7, Sanchez). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
voltage output steps as taught by Kudo into Sakuragi's image pickup method, as to make 
possible the advantages of providing an amplification type solid state imaging device capable 
of generating a relative light-strength detecting scheme and make it possible to take a 
preventive measure against shadow detail loss due to a voltage reset operation (col. 2, lines 
30-34, Kudo). 

And, it would also have been obvious to one of ordinary skill in the art to have further 
included the image sensor as taught by Sanchez into Kudo and Sakuragi's image pickup 
apparatus, as to make possible the advantages of providing a method and a system for 
dynamically correcting anomalous pixels in the raw data taken from an image sensor array 
such as a CCD or a CMOS sensor array, thus allowing the use of dumb cameras to capture 
digital images for subsequent use by an intelligent host-such as being displayed on a 
computer monitor (col. 2, lines 30-36, Sanchez). 

Allowable Subject Matter 

6. Claims 2- 1 8 are previously objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 



Conclusion 
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7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: Nishio et al. (US 7,263,215), Forst (US 6,753,914), Takayama et al. (US 
6,683,643), Kohashi et al. (US 6,642,960), Suzuki (US 5,327,246), and Katoh et al. (US 
5,625,413). 

Inquiries 

8. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Kent Wang whose telephone number is 571-270-1703. The examiner 
can normally be reached on 8:00 A.M. - 5:30 PM (every other Friday off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Ngoc Yen Vu can be reached on 571-272-7320. The fax phone number for the organization 
where this application or proceeding is assigned is 571-270-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://portal.uspto.gov/external/portal/pair. Should you have 
questions on access to the Private PAIR system, contact the Electronic Business Center 
(EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer 
Service Representative or access to the automated information system, call 800-786-9199 (IN 
USA OR CANADA) or 571-272-1000. 



KW 

20 March 2008 
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